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Abstract 

A statistical inference for random coefficient first-order autoregressive model [RCAR{1)] was investigated by 
P.M. ROBINSON (1978) in which the coefficients varying over individuals. In this paper we attempt to generalize 
this result to random coefficient autoregressive model of order p [RCAR (p)].The stationarity condition will derived 
for this model. 
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1 Introduction 

We can envisage several variants of the random coefficients autoregressive models. Most these variants are constructed 
while raising the different hypotheses progressively on the structure of the coefficients. One is interested then here 
in the RCAR (p) model whose coefficients vary by individual, while trying to study the statistical inference of this 
model one being based on Robinson's article (1978). 
We consider the RCAR [p] model, satisfying 



Yt (io) - Afc (a.) Yt_k (a.) + £* (w) . 



(1.1) 



fc=i 



The model (1.1) becomes 
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or 



Y,{u;) = Aiu;)Y,_,iu;)+e,{u;) 



(1.3) 



Where Y_^{u)) is the observable random variable, the t G {0, 1, 2, ...,T} and w G {1, 2, A''} indexes designate the 
time and the population of individuals respectively. 
We suppose that : 

(i) {et (w)} is an independent sequence of univariate random variables with mean zero and variance crj. 
(ii) Ai (uj), I < i <p are independent random variables with E {Ai (cj) , ...,Ap (co)} = {ai, ctj,)'. 
{in) Ai (w), I < i < p are mutually independent of St (w) and (w) for each t. 
(iv) {A {u)) , CO = 1, N} is an independent sequence ofp x p matrices with 



E{A{uj)}=A 







CXp CKp— 1 
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(v) There is no non-zero p x 1 constant vector Z such that Z'Yt (oj) is determined exactly as a linear function of 

{yt_iH,...,r*_p H}. 

{vi) Yt (co) is independent of Ss (w) for each s > t. 

In the following section we interested to study the conditions of stationarity as well as the conditions of existence 
and uniqueness of the stationary solutions. In the section 2 while basing on Robinson's survey that made on a 
RCAR{1) model , we try to have a generalization of the results gotten for the RCAR{p) model. 



2 Stationarity 

NichoUs and Quinn [6] use some models which also belong to the class of autoregressive processes of which the 
coefficients varying with time, and they got the conditions of stationarity for these models. 

Now we will find these conditions when the coefficients vary by groups of individuals under certain assumptions. 
We note that J^t ('^) is cr- field generated by a sequence {eg (t^) and Ak (w) , 1 < k < p, s < t} fov each w e {!,..., N}. 

Theorem 2.1 The process {Ft (w)} t = 0, 1, ... given by (1.1) from t = 1 is stationary if and only if 

Po = Pi 

. r^(o) = r^(i) 

Where Pi = E {Y, (w)} and {i - j) = E {F, {u) Yj (u)}. 



2 



Proof. See [6]. 



Theorem 2.2 The process {Yt {to)}; t = 0,1, ... given by (1.1) is stationary if and only if 13 = E {Y_q (w)} satisfies 
Ap = p and T^^ (0) = E {Y^ (uj) (ui)} satisfies the equation 



Vec [r„ (0)] = {A^A) Vec [T^ (0)] + 



(2.1) 



where (g) is the Kronecker product. 
Lemma 2.1 If the condition 



zP - aizP-'^ ap^Ofor \z\>l 



(2.2) 



is verified then the equation (2.1) has the unique positive definite matrix solution. This solution is explicitly given by 

oo 

Fec[r,(0)] = ^A'=n^A'^ (2.3) 



fe=o 



Corollary 2.1 For the process {Yt (w)} to be stationary it is necessary that a condition (2.2) is verified. 

Remark 2.1 The condition (2.2) is equivalent that the eigenvalues of the matrix A are less than unity in modulus. 

Andcl [1] has shown that midcr certain conditions on cj (uj) and Ai (tu), it is possible to get stronger properties 
for J^t (w)-nieasurablc solution {Yt (u))} to (1.1), in which casd random variables. 

Theorem 2.3 In order that there exist a stationary Tt (lS) -measurable solution {Yt (a;)} to (1.1) satisfying assump- 

r 

tions {i)-{iv), it is necessary that ^ (A ® Ay Vec [floj] converge as r ^ oo. 

When [A (g) A) does not have a unit eigenvalue, this latter condition is both necessary and sufficient, and there is a 
unique stationary solution {Yt (w)} obtained from 



Y,{Lo)=r^t (^)+E^'M^*-.-H 



(2.4) 



Where 



Vt {^) 







••• 

••• etiuj) 

Moreover when {et (w)} and {Ai (w)}^_i are also identically distributed sequences. Then this solotion is also strictly 
stationary and ergodic. 



Proof. See [6]. 
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3 Statistical inference for RCAR(p) 

In this section we will retain the same assumptions (i)- {vi) set forth above, adding that 
{vii) {et {to)} and {Ai (a;)}^^^ are also identically distributed sequences. 

So under the conditions {i)-{vii) and in accordance with the theorem of existence and uniqueness above there is the 
unique solution measurable strictly stationary and ergodic. 

Remark 3.1 In what follows one agrees that : 

{u) = E {Yj. {'jj)Y_-t-u ('^)' /^t (t^)} OS i-e. indicate the conditional covariance matrix. 
w (u) = E {Fj (w) Y_f_u (t^)'} indicate the uncondinal covariance matrix. 

Then we have 

E{Yt{Lj)/J^t{uj)} = a.s (3.1) 

T^{u)=E{Y,{u)Y,_^iu;)' /J^tiu)} a.s (3.2) 

where {.) is p x p the covariance matrix. 
For w = we have 

r.(0) = E{Y,{uj)Y'iu;)/J^t{u^)} 

= e{[A {cj) Y,_, {uj) + 6, (a;)] [A (a;) Y,_, (a;) + e, (a;)] ' /J^t (a;) } 

= A{u;)E {Y,_, {cj) {uj) jTt (a;)} A' (a;) + E {e, (a;) i, (a;) ITt (a;)} 

then 

(0) = A (w) (0) A! (w) + a.s 

The solution of this equation is 

vec (0)] = [/p2 - -1 [Q^j (-3^3^ 

r^, (w) = ^ (w) (u - 1) , u = 1, 2, ... a.s 



by recurrence we obtain 



r„ (u) = A" (cj) (0) , u = 1, 2, ... a.s (3.4) 
Vec [r^ (u)] = (Jp (g) ^" (w)) l/ec [F^ (0)] a.s 



Fee [r^. («,)] = /p A" (co) [/p2 - (a;)] Vec[0^] a.s (3.5) 
Since the matrix F^^ (0) is non singular, it may be identified as 

A(a;) = £;{y,('^)i:UiH/^t(a;)}[^{F,(^)i:U'^)/-^t(a;)}]"' 

= F,(l)Fji(0) (3.6) 
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Consider At (w) given by 



At (w) 

'.t=i J Lt=i 

Then, under slightly stronger conditions above we have that, for u > 



p lim 



T+U 

t=i 



for any fixed u so that 



p Ym\ ^ 4r (<^) - A(yj) ) = 



(3.7) 



(3.8 



(3.9) 



We assume that A(a;) has all its eigenvalues within the unit circle. Then in the usual terminology {Y.t W)) is an 
Aii(p) and {F^ (w)} is ergodic in the sense that, if (u) = E^^^ ^^Xlt-u ('^)} then (3.8) and (3.9) become 



p lim 



0, Vu 



T+u 
t=l 

p Um ( At (w) - A ) = 

where A is a such matrix, which its eigenvalues are in the unit circle unit. 

In the next subsection we will show that the moments of A (uj) can be identified in terms of T^j (?/), then we will 
estimate the moments of A (uj) while studying their asymptotic behavior as -ZV — > oo while T stays fixed, under some 
conditions on the eigenvalues of the matrix A {w). 

But an alternative approach more evident believes A (w) by one of the usual estimators for example estimator 
ordinary least squares, then it is estimated moments from, but this approach has several disadvantages such as: 

Especially when T is not large enough we can not estimate A({J) and our approach seems more quicker and 
direct. Second the estimator of A (uj) will not have in fact eigenvalues in the unit circle unit. Third, the asymptotic 
properties of estimators of (u) obtained from the estimator of A (w) are less easy and accessible than those obtained 
by our estimators. 

3.1 Identifying moments of A(a;) 

Theorem 3.1 1^ the matrix A(lo) has all its eigenvalues within the unit circle, then : 



j;=0 



(3.10) 



v=0 



where : /x^, = E {A^^^' (co)} and m^.^^ = E {a {uT ® A (0;)''+"} 



(3.11) 
(3.12) 
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Proof. Since the eigenvalues of the matrix A{(j)^ have the form AjAj , i,j = l,...,p where Aj and Xj are the 
eigenvalues of the matrix A{uj) which its eigenvalues within the unit circle i.e. |AjAj| < 1 then Ip2 — A{cu)'^^ is 
not singular matrix, 



Vec [T^ (0)] = Vec [E {Y, (a;) (a;)}] =e\ I^. - A (a;) 



E 



+ ... 



= [e [If] +e[a (a;)®^} +e[a [uf^] + E [a {u)^^] ...] Vec [Q, 

CO 



■y=0 



therefore 



vec[T^{u)] = E[{Ip(^A''{u;))[lf^+A{uf^ +A®^{i^) + ..^Vec[n^]^ 

= E{lp(g) A" (w) + A (w) (g) (w) + ^2 (w) (g) ^2+" (w) + ...} Vec [n^ 

OO 



v=0 



Definition 3.1 The spectral density of (1.1) model is given by 

OO 

= ^ E Tf-He-^^", Ae 

Theorem 3.2 When S (A) ea;ist i/ien 



Vec[S{X)] = - 



/Lt^^Fec [^ui] , pour A = 



Proof. 



OO 



Fec [S (A)] 



27r 



(0) + E e"'^" + E (") e'^" 



1 

2^ 



Vec [T„ (0)] + ^ Vec [T„ (w)] e"'^" + J2 ^ec [T^, (u)] e^^^ 

^ / OO oooo csooo \ 

= ^ E + E /£„ E /^2„^-^'" + E E M^.^"" [^^' 

\f— n=l v=Q u=l v=0 / 



where [i' = E {A^ (a;) ® 1^}. For A = 0, we have 



Vec[S{\)] = — 



OO 



(3.13) 



(3.14) 



v=0 
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Theorem 3.3 It is necessary that the matrix [lp2 — Ip^ A (w)] ^ is invertible, for S (A) to exist and be continuous. 



Proof. If [Ip2 -Ip^A (w)] is invertible matrix, this is equivalent that the eigenvalues of the matrix Ip^A (w) are 
inside the circle unit i.e. those of the matrix A (co) are also inside the circle unit i.e. |Aj| < 1, 1 < i < p, then 



([/p2 -Ip®A{uj) 



thus 



smce 



p2 - (2Ip (g)A{Lv)- [Ip (g) A 
/p®2 + 2[Ip®A (w)] +3[lp^A (w)'] + 4 [jp ® ^ {tof 

OO 



+ ... 



u=0 



E|([V-A«2(a;)]y'|=f:(«+l)M, 

^ u=0 



\Vec[S{Xm = 



< 



OO 

^ Fee [n,,] 



M=0 



< OO 



3.2 Estimation and asymptotic behavior 
Definition 3.2 For <u <T we define 



T+u N 



(r _^ + i)jv EE^«(^)^^-»H 



t=l u;=l 



which is an unbiased estimator of {u) . 
Theorem 3.4 The n.s. condition that 

lim Vec Tjv(w) =Vec[Ti^{u)] p.s 

N—^oo L J 

for all u = 0,1, ...,T is that the matrix A {u) has all its eigenvalues within the unit circle. 



are iid random variables for lo = 1, N. So in order that Vec 

( T 



(3.15) 



(3.16) 



Proof. Consider, first Vec T jv (0) noting that 

T 

E^*N^tM, a; = 1,2,... 

TTat (0) — » Vec \Tui (0)] p.s, it is necessary that 
Vec E{J^Y^{oj)r^{u;) 



< OO 



thus \\Vec [E {y^ {u)) (w)}] || < oo, t = 0, T, which is equivalent that the matrix A (w) has all its eigenvalues 
within the unit circle. 

To prove sufRciency, we note that for (4. 20), it is sufficient for all u : 

{T-u 
t=0 



< oo 



which is true by inequality of Schwarz, if \\Vec [E {y^ (w) y^ (w)}] || < oo, t = 0, T, and this is verified if the 
matrix A {u) has all its eigenvalues within the unit circle. ■ 

Definition 3.3 We define the estimators Ojv and pL {u) o/Ot^ and /U = E {Ip (g) A^ (w)} respectively by 



Vec 
Vec 



Tn (m) = Ajv (w) ^ec Tn (0) 



Ip2 - h (2) Fee Tn (0) 



Theorem 3.5 // the matrix A (w) /las all its eigenvalues within the unit circle then 



lim Vec 

AT— >oo 



N 



Vec^^j], and lim Vec 'jl An) 



Vec 



a.s, for u = 1, T — 2 



(3.17) 



Moreover to that 



N Vec 



Tn (0) - (0) 



.,Vec 



Tn (T) - (T) 



(3.18) 



converges as N ^ oo to {T + 1) — dimensional normal variate wiyh zero means and covariance matrix blocks S, 
having {p + 1, ^ + l)th matrix 



lim NCov Vec 



N- 



(Vec [Tat (p) 



,Vec 



it is necessary and sufficient that the matrix A (oj) has all its eigenvalues within the unit circle. 
Proof. Necessary condition : we note that 



E^tH^tM' ^ = 1,2,. ..TV 



t=o 



are iid random variables. 



In order that v N 



^ AT (0) — (0) is asymptotically normal, it is necessary and sufficient that : 



< oo. 



According to the central limit theorem for the iid random variables, which is true if and only if 



E{Y,{u;)r,{u,)y 



oo, but this inequality is equivalent that the matrix A (w) has all its eigenvalues within the unit circle. 



< 



Sufficient condition : now, for \/N 
and sufficient that 



(u) — (u) is also asymptotically normal for any u > 1, it is necessary 



/'T-u 



E[J2Yt{^)Yt_^i^) 



< oo 
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which is true if the matrix A {ui) has all its eigenvalues within the unit circle, using Schwarz inequality. 

Therefore the that the matrix A (uj) has all its eigenvalues within the unit circle is necessary and sufficient condition 



, u > 0, to be asymptoticallysoit multivariate normal. 



for any combination of the Tjv (w) — T^, (u) 
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